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ROBERT  E.  LOONEY 

DARPA’s  Policy  Analysis  Market 
for  Intelligence:  Outside  the  Box  or 
Off  the  Wall? 


The  difficulty  lies  not  so  much  in  developing  new  ideas  as  in  escaping 
from  old  ones. 

Practical  men,,  who  believe  themselves  to  be  quite  exempt  from  any 
intellectual  influences,  are  usually  the  slaves  of  some  defunct  economist. 

—John  Maynard  Keynes 

The  Defense  Advanced  Research  Projects  Agency  (DARPA)  was  born  in 
the  uncertain  days  after  the  Soviet  Union  launched  its  Sputnik  satellite 
in  1958.  Its  mission  was  to  become  an  engine  of  technological  change 
that  would  bridge  the  gap  between  fundamental  discoveries  and  their 
military  use.1  Over  the  last  five  decades,  the  Agency  has  efficiently  gone 
about  its  business  in  relative  obscurity,  in  many  cases  not  getting  as 
much  credit  as  it  deserved.  The  Agency  first  developed  the  model  for  the 
Internet,  as  well  as  stealth  technology.  More  recently,  DARPA 
innovations  have  spanned  a  wide  array  of  technologies.  To  name  a 
couple:  computers  that  correct  a  user’s  mistakes  or  fix  themselves  when 
they  malfunction,  and  new  stimulants  to  keep  soldiers  awake  and  alert 
for  seven  consecutive  days. 


Dr.  Robert  E.  Looney  is  Professor  of  National  Security  Affairs  and  Associate 
Chairman  of  the  Department  of  National  Security  Affairs  at  the  Naval 
Postgraduate  School,  Monterey,  California.  The  author  of  more  than  twenty 
books  on  various  aspects  of  economic  development,  he  has  been  an  advisor  to 
the  governments  of  Panama,  Mexico,  Jamaica,  Iran,  and  Saudi  Arabia. 
Dr.  Looney  was  previously  a  development  economist  at  the  Stanford 
Research  Institute,  and  a  faculty  member  at  the  University  of  California 
(Davis)  and  the  University  of  Santa  Clara. 
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Because  DARPA  is  mandated  to  take  on  risky  projects,  failures  have 
occurred.  For  the  most  part,  the  Agency’s  low  profile  has  protected  it  from 
inaccurate  scare  stories  cropping  up  in  the  popular  press.  In  2003, 
however,  DARPA  managed  to  make  the  front  pages  twice,  both  times  with 
disastrous  results.  Early  in  the  year,  Congress  moved  to  scale  back  the 
Agency’s  Terrorism  Information  Awareness  Program  (TIA).  In  an  effort  to 
spot  patterns  of  terrorist  activity,  the  TIA  proposed  the  development  of 
advanced  computer  systems  capable  of  scanning  commercial  databases 
containing  information  on  millions  of  Americans. 

Then,  in  late  July,  the  Agency  backed  off  a  plan  to  set  up  a  kind  of  futures 
market,  a  Policy  Analysis  Market  (PAM),  that  would  allow  investors  to  earn 
profits  by  betting  on  the  likelihood  of  such  events  as  regime  changes  in  the 
Middle  East.  Critics,  mainly  politicians  and  newspaper  op-ed  writers, 
attacked  the  futures  project  on  the  grounds  that  it  was  unethical  and  in 
bad  taste  to  accept  wagers  on  the  fate  of  foreign  leaders  and  the  likelihood 
of  terrorist  attacks.  The  project  was  canceled  a  day  after  it  was  announced. 
Its  head,  retired  Admiral  John  Poindexter,  subsequently  resigned.2 

The  debate  over  the  Policy  Analysis  Market  was  quite  contentious,  but  few 
answers  have  been  found  to  several  critical  questions:  How  were  the  markets 
supposed  to  work?  What  were  PAM’s  underlying  theoretical  and  empirical 
assumptions?  What  was  PAM  supposed  to  produce  in  the  way  of 
intelligence?  Was  the  project  an  innovative  way  of  thinking  outside  the  box 
or  just  an  off-the-wall  idea? 


PAM’S  PROJECTED  MISSION 

With  the  development  during  the  last  several  decades  of  well-functioning 
futures  markets  for  many  commodities,  private  sector  analysts  often  use 
their  prices  as  indictors  of  potential  events.3  The  use  of  petroleum  futures 
contract  prices  is  an  example  of  the  manner  in  which  traders  gauged  the 
likely  outcome  of  events  such  as  the  United  States’s  naval  response  to 
Iraq’s  invasion  of  Kuwait  in  1990. 4  In  a  like  manner,  the  movement  of 
petroleum  futures  prices  in  late  March  2003,  shortly  after  the  second  Iraq 
War  began,  reflected  the  implications  traders  drew  concerning  the  outcome 
of  the  conflict—  falling  rapidly  in  the  first  few  days  of  the  conflict,  but 
rising  again  after  it  became  apparent  the  Iraqi  regime  would  not  fall  in  a 
matter  of  days.5  Before  the  Iraq  War  began,  oil  prices,  incorporating  a  war 
premium,  suggested  there  was  a  very  high  probability  of  a  conflict.6 

In  a  similar  fashion,  the  proposed  Policy  Analysis  Market  would  have 
provided  U.S.  intelligence  agencies  access  to  a  wide  variety  of  markets  in 
various  events.  Trading  in  these  events,  as  in  the  case  of  petroleum  futures, 
would  produce  price  movements  that  could  be  easily  translated  into  the 
likely  occurrence  of  future  incidents,  such  as  a  coup  in  Yemen. 
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The  presumption  was. that,  in  many  cases,  intelligence  derived  in  this 
manner  would  be  more  accurate  than  that  obtained  through  traditional 
means  (see  Figure  1,  from  the  original  PAM  Website).  Initially,  the  site 
was  to  be  confined  to  political  economic,  civil,  and  military  futures  of  the 
key  Middle  Eastern  countries  of  Egypt,  Jordan,  Iran,  Iraq,  Israel,  Saudi 
Arabia,  Syria,  and  Turkey,  and  the  impact  of  U.S.  involvement  with  each. 
A  typical  bet  would  involve  issues  such  as  whether  the  United  States 
would  pull  its  troops  out  of  Saudi  Arabia,7  or  whether  the  Egyptian 
currency  was  likely  to  fall  by  twenty  percent  by  the  end  of  the  year. 
Assassinations,  the  most  controversial  feature  of  PAM  and  the  most 
publicized,  were  not  officially  listed  as  a  likely  market. 

Operationally,  PAM  planned  to  offer  three  types  of  futures  contracts: 

•  Quarterly  contracts  based  on  data  indices  that  track  economic  health,  civil 
stability,  military  disposition,  arid  U.S.  economic  and  military  involvement  in 
Egypt.  Iran,  Iraq,  Israel,  Jordan,  Saudi  Arabia,  Syria,  and  Turkey; 

•  Quarterly  contracts  that  track  global  economic  and  conflict  indicators  such  as 
the  likely  occurrence  of  a  regime  change  in  Syria; 

•  Specific  possible  events  (e.g. ,  U.S.  recognition  of  Palestine  in  the  first  quarter  of 
2005). 

At  the  expected  start  of  trading  (1  October  2003),  there  were  to  be  contracts 
of  the  first  two  types.  These  were  scheduled  to  mature  at  the  end  of  the  fourth 
quarter  2003,  first  quarter  2004,  second  quarter  2004,  and  third  quarter  2004. 
On  1  January  2004,  contracts  were  to  be  issued  that  matured  at  the  end  of  the 
fourth  quarter  2004.  In  this  way,  PAM's  forward  view  was  to  be  maintained 


Figure  1. 
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Probability  of  Terrorist  Activity  (%) 

DARPA’s  Vision  of  the  Contribution  of  Markets  to  Intelligence 


Predicting  Hostilities 
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at  one  year.  The  plan  was  to  add  contracts  of  the  third  type  as  relevant 
situations  presented  themselves. 

Another  design  innovation  would  have  permitted  traders  to  take  positions 
based  on  interrelated  issues.  For  example,  the  economic  health  of  a  country 
may  affect  civil  stability  in  the  country,  and  the  disposition  of  one  country’s 
military  may  affect  the  disposition  of  another  country’s  military.  The  trading 
process  at  PAM’s  heart  allowed  traders  to  structure  combinations  of  futures 
contracts  (see  Figure  2,  from  the  original  PAM  Website).  Such  combinations 
were  to  be  structured  to  represent  predictions  about  interrelated  issues  of 
critical  interest  to  the  intelligence  community.  The  idea  here  was  to  create 
chains  of  events  leading  up  to  the  activity  of  main  concern.8  Trading  in 
event-structured  derivatives  of  this  type  was  expected  to  result  in  a 
substantial  refinement  in  predictive  power.  In  effect,  this  process  would  be 
similar  to  the  Bayesian  probabilistic  forecast  techniques  used  from  time  to 
time  by  intelligence  agencies  such  as  the  Central  Intelligence  Agency 
(CIA).9  In  short,  the  PAM’s  conditional  hedges  would  have  made  these 
markets  much  more  comprehensive  and  detailed  than  current  online 
futures  exchanges,  such  as  www.tradesports.com. 

Another  limitation,  from  the  intelligence  community’s  perspective,  of  other 
on-line  sites  is  that  markets  in  specific  events  of  national  security  interest  (or 
the  derivative  driven  scenarios)  are  difficult  to  start  because  most  players 
would  be  unwilling  to  take  an  initial  position— that  is,  to  be  a  market 
maker,  willing  to  accrue  potential  losses  as  the  markets  subsequently 
moved  to  new  equilibria.10  To  overcome  this,  the  government  would  have 
been  the  market  maker  in  PAM,  implying  an  on-going  stream  of  public 
subsidies  throughout  the  market’s  existence.  As  Peter  Coy  notes,  “By 
giving  odds  to  well-informed  bettors,  the  Pentagon  would  lose  money  on 
average.  But  with  bets  limited  to  $100,  it  would  have  been  a  small  price  to 
pay  for  a  snapshot  of  expert  opinion.” 

Finally,  as  a  means  of  ensuring  the  smooth  arid  efficient  start 
of  live  operations,  registration  was  to  be  limited  initially  to  1000  traders. 
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Figure  2.  Example  of  PAM  Futures  and  Derivatives  Contracts 
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As  system  operations  were  tuned  to  the  trading  load,  this  limit  was  to 
be  increased.  The  plan  was  to  have  at  least  10,000  traders  by  1  January 
2004. 

THEORY  UNDERLYING  PAM 

The  Pentagon  contended  that  the  system  was  soundly  based  on  economic 
theory-— specifically,  the  theory  of  efficient  markets  and  market  discovery. 
Here  the  Pentagon  cited  the  fact  that  many  futures  markets  have  a  history 
of  predicting  events  better  than  individual  experts  do.  In  this  sense,  the 
Pentagon  may  have  lagged  a  bit  behind  the  times.  In  the  early  1980s,  the 
efficient  market  theory  was  widely  accepted  by  academic  and  Wall  Street 
economists.  The  thrust  of  this  view  stressed  the  fact  that  securities  markets 
were  extremely  efficient  in  reflecting  information  about  individual  stocks 
and  about  the  stock  market  as  a  whole. 

The  main  mechanism  driving  market  prices  is  the  rapid  dissemination  of 
reliable  and  accurate  information.  Acting  on  this  information,  traders  in 
effect  immediately  incorporate  it  into  the  prices  of  securities.  Information- 
driven  prices  equilibrate  so  fast  that  neither  technical  analysis  (the  study  of 
past  stock  prices)  nor  even  fundamental  analysis  (the  examination  of 
financial  information  such  as  company  earnings  and  asset  values)  would 
enable  an  investor  to  achieve  returns  greater  than  those  that  could  be 
obtained  by  holding  a  randomly  selected  portfolio  of  individual  stocks,  at 
least  not  for  shares  with  comparable  risk.11  One  major  assumption  of  the 
efficient  market  theory  is  that  if  the  flow  of  information  is  unimpeded,  and 
information  is  immediately  reflected  in  stock  prices,  then  tomorrow’s  price 
change  will  reflect  only  tomorrow’s  news  and  will  be  independent  of 
today’s  price  changes. 

The  efficient  market  theory  was  largely  developed  to  explain  price 
movements  in  the  U.S.  stock  market.  But  the  PAM  was  not  going  to  trade 
in  highly  liquid  securities,  where  millions  of  highly  sophisticated  traders 
made  their  daily  living.  Instead,  DARPA  assumed  that  the  efficient  market 
theory  could  be  easily  extended  to  other  types  of  markets.  The  belief  is 
that  any  market  with  many  hundreds  or  thousands  of  participants,  making 
many  tens  of  thousands  of  decisions,  generates  an  equilibrium  price  that 
will  hold  more  information  than  any  one  individual  expert  or  team  of 
experts.  As  John  Delaney,  chief  executive  of  Tradesports.com,  notes  “It  is 
reasonable  to  assume  that  if  you  have  20,000  people  from  eleven  countries 
all  trading  on  whether  Saddam  will  be  caught  by  the  end  of  September, 
that’s  probably  going  to  give  you  a  very  good  r^al-money  predictor.”12 
How  is  this  possible?  In  the  simplest  terms,  markets  are  collectively 
intelligent,  even  when  the  actors  making  up  those  markets  are  individually 
dumb — -the  “dumb  agent  theory”  of  market  discovery. 
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Examples  of  the  dumb  agent  theory  abound  in  the  literature.  James 
Surowiecki13  provides  several  excellent  examples:  (1)  Every  year  Michael 
Mauboussin,  an  investment  strategist  at  Credit  Suisse  First  Boston,  teaches 
a  class  at  Columbia  Business  School.  On  the  first  day  of  class,  he  passes 
out  a  form  and  asks  the  students  to  estimate  IBM’s  assets  at  the  end  of 
1989  (not  a  number  that  you  would  expect  even  business  students  to  know 
exactly).  Every  year,  without  fail,  the  mean  of  all  the  responses  is  within  5 
percent  of  the  actual  number.  (2)  Mauboussin  also  assembles  a  good-sized 
group  of  people  (100-125)  and  gives  them  a  ballot  for  the  Oscars.  On  one 
side  are  the  six  most  popular  categories — Best  Picture,  Best  Actress,  Best 
Actor,  Best  Supporting  Actor,  Best  Supporting  Actress,  Best  Director— 
and  on  the  other  are  six  more  esoteric  categories.  To  play,  each  participant 
chips  in  a  dollar  and  then  guesses  who  will  win  the  Oscar  in  each  category. 
Obviously,  some  of  the  participants  know  a  lot  about  the  movies  and 
about  the  Oscars,  and  some  know  very  little.  But  without  fail,, the  group’s 
mean  response  across  the  twelve  categories  does  better  than  any  single 
human.  Two  years  ago,  the  group  got  11  out  of  12  right,  while  the  best 
single  individual  only  got  nine  right.  From  these  examples  Surowiecki 
concludes: 

I  don’t  know  about  you,  but  I  find  these  stories  absolutely  eerie  and 
absolutely  instructive.  Taken  together,  what  they  seem  to  suggest — I 
want  to  say  “prove,”  but  I’ll  refrain — is  that  the  collective  response  of 
a  group  to  any  question  of  knowledge  is  going  to  be  both  the  best 
response  possible  (the  Oscar  example)  and  a  remarkably  accurate 
response  as  well  (the  IBM  example).14 

Another  example  of  market  discovery  concerns  the  stock  market  reaction 
to  the  1986  Challenger  spacecraft  crash.  In  examining  the  market’s  response 
to  the  accident,  Michael  Maloney  and  J.  Harold  Mulherin  find  abundant 
evidence  of  the  speed  and  accuracy  of  the  market  in  finding  the  source  of 
the  shuttle’s  demise.  While  the  event  was  widely  observed,  it  took  several 
months  for  an  esteemed  panel  to  determine  which  of  the  mechanical 
components  failed  during  the  launch.  By  contrast,  Maloney  and  Mulherin 
find  in  the  period  immediately  following  the  crash,  securities  trading  in  the 
four  main  shuttle  contractors  seemingly  singled  out  the  firm  that 
manufactured  the  faulty,  component.  Further,  they  show  that  price 
discovery  occurred  without  large  trading  profits,  as  the  efficient  market 
theory  would  predict.15  ' 

While  the  movement  of  the  Morton  Thiokol  Company’s  stock  would  seem 
to  be  a  strong  verification  of  market  efficiency — the  notion  that  stock  prices 
quickly  and  accurately  respond  to  new  information— the  authors  correctly 
don’t  take  this  to  mean  that  we  should  scrap  commissions  and  instead 
simply  look  at  the  market  movements  when  disasters  involving  publicly 
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held  companies  occur.  The  problem  is  that  Maloney  and  Mulherin  still 
cannot  figure  out  how  and  why  the  market  knew  to  blame  Morton 
Thiokol.16  They  pretty  much  rule  out  insider  information,  but  they 
conclude  they  don’t  have  any  other  good  explanation:  “While  markets 
appear  to  work  in  practice,  we  are  not  sure  how  they  work  in  theory.” 
Clearly,  statements  like  this  leave  doubts  about  placing  excessive  reliance 
on  the  ability  of  markets  to  generate  accurate  intelligence  quickly  and 
unambiguously.  ' 

Still,  DARPA  saw  the  dumb  agent  theory  as  a  key  to  revolutionizing 
intelligence.  Its  use  in  markets  would  presumably  uncover  and  aggregate 
diverse  pieces  of  information  to  an  extent  not  previously  possible  because 
there  would  be  no  bureaucratic  or  political  factors  influencing  the 
participants’  decisions.  In  effect,  this  system  would  eliminate  many  of  the 
hurdles  that  impede  the  flow  of  information  within  organizations. 
According  to  Surowiecki,  “That’s  especially  important  in  the  case  of  the 
intelligence  community  because  we  know  that,  for  example,  in  the  case  of 
11  September  2001  (9/11)  there  was  lots  of  valuable  and  relevant 
information  available  before  the  attack  took  place.  What  was  missing  was 
a  mechanism  for  aggregating  that  information  in  a  single  place.  A  well- 
designed  market  might  have  served  as  that  mechanism.”17  Clearly,  the 
operative  phrase  is  “a  well-designed  market.” 

This  concern  about  the  usefulness  of  markets  in  providing  national 
security-related  intelligence  was  born  out  by  the  recent  Columbia  shuttle 
disaster,  where  the  market’s  response  was  not  so  accurate.  Among  the 
publicly  traded  National  Aeronautics  and  Space  Administration  (NASA) 
contractors,  the  biggest  loser  was  Alliant  Techsystems,  Inc.,  the  current 
owner  of  Thiokol,  which  made  the  shuttle’s  booster  rockets.  Alliant’s 
stock  fell  almost  exactly  the  same  amount  that  Morton  Thiokol’s  did 
after  the  earlier  Challenger  crash — about  11.66  percent.  Boeing,  which 
now  owns  Rockwell  International,  another  major  NASA  contractor,  fell 
1.5  percent,  and  Lockheed  Martin  fell  about  3  percent.18  Daniel  Gross 
notes  that, 

The  market — perhaps  remembering  Thiokol’s  implication  in  the  prior 
disaster — swiftly  punished  Alliant.  Wrongly,  it  seems.  Thus  far, 
attention  has  focused  on  the  performance  of  foam  insulation  lining  the 
external  fuel  tanks,  which  were  made  by  the  Michoud  unit  of 
Lockheed  Martin.  The  Market  may  be  efficient.  But  it  can  also  be 
emotional.  Did  traders  with  long  memories  rush  to  sell  Alliant 
disproportionately  because  Morton  Thiokol  was  deemed  responsible 
for  the  Challenger  disaster?  Almost  certainly.19 

In  sum,  the  efficient  market  theory  underlay  the  design  of  PAM.  The  idea 
of  efficient  markets  was  in  vogue  mainly  in  the  1970s,  and  while  still  a 
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formidable  theory,  it  has  lost  much  of  its  luster — no  doubt  partially  the 
reason  so  few  prominent  economists  came  to  the  program’s  defense.  The 
Columbia  shuttle  case  provides  an  instructive  note  of  caution  in  placing 
exclusive  stake  in  market-derived  intelligence. 

ARGUMENTS  AGAINST  THE  FUNDING  AND  DEVELOPMENT  OF  PAM 

The  main  public  criticisms  of  PAM  came  from  politicians  and  editorial 
writers,  who  somewhat  unfairly  focused  on  the  potential  use  of  the 
Policy  Analysis  Market  to  predict  terrorist  acts  and  assassinations — 
markets  unlikely  to  ever  be  included  in  the  PAM.  Here,  the  main 
objections  to  the  program  were  based  on  either  (a)  ethical/moral 
grounds — critics  branded  the  program  as  in  “bad  taste”  or  “ghoulish,” 
and  suggested  that  it  encouraged  “betting  on  death,”  or  that  it  was  a 
government-sponsored  “betting  parlor”;  or  (b)  doubts  about  its  makeup 
and  main  premise.  The  program  was,  without  much  elaboration, 
characterized  as  “bizarre”  or  “harebrained.”  Although  the  PAM  was  a 
very  minor  budgetary  item  by  Washington  standards — perhaps  less  than 
$1  million  to  launch — it  was  also  dubbed  a  “waste  of  money.”  More 
sophisticated  arguments20  came  from  several  noted  economists,  including 
a  former  Nobel  Prize  winner,  Joseph  Stiglitz.21  The  main  points  of 
contention  follow. 

A.  The  System  Creates  a  Strong  Incentive  for  Someone  to  Buy  Futures 
In  a  Violent  Act  and  Then  Carry  Out  the  Act — The  Insider  Information 
Problem 

This  possibility  already  exists,  with  terrorists  suspected  of  shorting  on 
airline  and  hotel  stocks  right  before  9/11.  The  stock  market  fell  2.8 
percent  following  President  John  F.  Kennedy’s  assassination  on  22 
November  1963;  it  fell  4.9  percent  following  the  2001  attack  on  the 
World  Trade  Center;  and  the  oil  markets  gyrate  wildly  with  each 
assassination  attempt  in  the  Middle  East.22  Some  intelligence  analysts 
contend  that  Iraq’s  former  dictator,  Saddam  Hussein,  speculated  on  oil 
futures — going  long  and  then  menacing  neighboring  Kuwait  or  issuing 
some  bombastic  threat,  and  then  pocketing  a  nice  profit  for  his  efforts. 
But,  given  the  limits  on  the  size  of  trades  conducted  on  the  PAM,  the 
likelihood  that  terrorists  'betting  on  their  own  operations  could  make  a 
great  deal  of  money  is  highly  unlikely. 

Clearly,  terrorists  determine'd  to  profit  from  their1  actions  can  easily  buy 
derivatives  to  cash  in  on  their  actions.  Of  course,  \fiey  will  leave  behind  a 
paper  trail.  But  more  to  the  point,  all  that  these  prediction  markets  will  do 
is  make  the  information  content  of  such  trading  more  transparent  to 
policymakers.23  In  any  case,  by  being  willing  to  lose  money  on  the  market, 
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the  market  maker,  the  Defense  Department,  would  be  able  to  get  information 
at  a  price. 

B.  Markets  May  Not  Be  Efficient  in  the  Short-Run 

Here,  the  argument  is  that  the  static  value  of  a  contract  wouldn’t 
communicate  any  information;  only  changes  in  prices  would  be  of  interest. 
Basically,  this  argument  assumes  that  the  bulk  of  price  fluctuations  on 
stock  and  futures  markets  are  driven,  not  by  the  emergence  of  new 
information,  but  only  through  herding.' Thus,  extracting  a  signal  (i.e., 
information)  about  the  change  in  the  likelihood  of  particular  events  from 
such  a  market  would  be  difficult.  “This  is  more  the  case  over  the  short¬ 
term  than  the  long-term.  But  it  is  short-term  changes  in  the  likelihood  of 
events  that  are  of  the  greatest  interest.”24 

This  criticism  may  be  more  on  the  mark  for  certain  types  of  PAM  markets, 
especially  those  where  the  participants  are  not  particularly  knowledgeable,  or 
where  public  information  is  rather  limited.  The  efficient  market  theory  came 
under  attack,  starting  in  the  1980s,  when  sophisticated  research  found  a 
number  of  facts  at  odds  with  what  efficient  markets  would  have  produced. 
For  example,  stocks  that  performed  poorly  in  one  period  typically  did  better 
on  average  over  time.  If  markets  were  truly  efficient,  well-informed  investors 
should  have  sprung  into  immediate  action  and  bought  these  poorly 
performing  stocks  well  before  anyone  had  the  chance  to  make  a  big  profit.25 

In  short,  it  became  increasingly  clear,  even  to  economists,  that  human 
psychology  and  behavior — sometimes  irrational — affected  stock  prices. 
The  newer  theories  of  behavioral  finance  appear  to  explain  a  number  of 
recent  market  phenomena  as  well  as  or  better  than  the  efficient  market 
hypothesis. 

Similarly  with  the  dumb  agent  theory,  most  of  the  successful  experiments 
noted  earlier  were  undertaken  with  participants  voting  in  private,  with  their 
answers  later  presented  to  the  group  as  a  whole.  If  each  participant  had 
shouted  out  or  registered  his  “vote”  in  public,  there  is  sufficient  reason  to 
believe  this  information  would  have  influenced  the  position  of  subsequent  votes. 

Emotional  or  psychological  factors  could  easily  affect  the  outcome  in,  say, 
the  market  for  terrorism  futures.  Several  near-spaced  terrorist  attacks  would 
no  doubt  dramatically  raise  the  market  price  on  terrorist  futures,  even  though 
there  might  not  be  any  connection.  Even  in  something  like  oil,  some  time 
passed  before  traders  refrained  from  acting  on  emotion,  but  realized 
instead  that  prices  have  normal  ceilings  and  floors  over  time,  based  on 
supply  and  demand  adjustments.  Nothing  like  this  appears  to  encumber 
terrorist  attacks. 

In  sum,  the  market  failure  objection  to  PAM  does  have  some  validity. 
PAM’s  market  efficiency  premise  is  no  longer  the  dominant  market  theory 
as  in  the  1970s.  Since  then  several  behavioral  theories  have  gained 
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increasing  acceptance.  In  short,  DARPA  may  have  put  too  much  faith  in  a 
theory  that  is  being  increasingly  questioned  in  the  economics  profession. 
Operationally,  the  “dumb  agent”  theory  often  cited  as  producing  striking 
results  in  private  surveys  would  also,  when  applied  in  an  on-line 
environment,  come  under  the  same  criticisms. 

C.  The  System  Would  Create  Incentives  for  Participants  to 
Manipulate  the  Market  by  Spreading  Rumors  About  the 
Likelihood  of  Events 

That  is,  this  activity  would  further  decrease  the  signal  from  the  market,  and 
increase  the  amount  of  noise  heard  by  intelligence  agencies  attempting  to 
monitor  threats  in  a  more  conventional  way. 

Rumors,  of  course,  are  a  part  of  any  market— the  wise  investors  who 
make  money  in  the  longer  term  know  what  they  need  for  verification. 
Those  not  so  wise  are  soon  out  pf  the  market,  and  are  no  longer  able  to 
bias  it  in  the  wrong  direction. 

The  fact  that  governments  would  use  the  markets  to  predict  events,  and 
then  take  action  to*  see  that  they  don’t  occur,  would  mute  any  signal.  What 
if  the  value  of  the  futures  contract  on  the  assassination  of  a  friendly 
foreign  leader  were  to  rise  rapidly?  Clearly,  action  would  soon  take  place 
to  increase  protection  of  the  leader — in  essence  reducing  the  likelihood  of 
the  event,  and  the  value  of  the  contract.  Because  market  participants 
recognize  this,  the  market  would  never  show  the  initial  steep  rise  in  the 
value  of  the  contract. 

This  is  pretty  much  a  straw  man  argument — focusing  on  a  market  unlikely 
to  be  offered  on  the  proposed  PAM.  Of  the  markets  mentioned  on  the 
original  PAM  site,  it  is  hard  to  see  how  any  would  meet  the  conditions 
where  events  could  be  easily  altered.  Those  that  might,  like  U.S.  policy 
responses,  could  be  handled  with  conditional  datives. 

D.  Participants  Would  Have  Doubts  that  Anyone  Could  Ever 
Cash  In  on  a  Futures  Contract  as  It  Is  Likely  that  Public 
Outrage  Would  Not  Allow  It 

It  is  hard  to  imagine,  for  example,  that  Congress  would  have  allowed  anyone 
to  collect  on  a  futures  contract  who  had  bet  that  the  1 1  September  attacks 
would  occur.  Consequently,  market  fluctuations  will  contain  even  less 
signal,  and  changes  in  market  prices  will  reflect  perceptions  of  the 
likelihood  of  a  payoff  being  sanctioned. 

This,  then,  is  another  straw  man,  based  on  a  market  not  likely  to  be  offered 
on  the  PAM.  Besides,  once  the  government  reneged  on  paying  off  a  bet  of 
this  sort,  there  would  be  no  more  action  on  thexPAM  market — rhardly  in 
DARPA’s  best  interest. 
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E.  Future  Contracts  Can  Be  Written  Only  for  Events  that 
Are  Explicitly  Anticipated 

Many  events  of  interest,  for  example,  an  attack  on  the  World  Trade  Center 
via  hijacked  passenger  planes,  are  unlikely  to  be  anticipated.  Again,  this  is 
beside  the  point,  since  these  contracts  were  not  likely  to  be  offered.  PAM 
was  interested  in  a  whole  spectrum  of  more  general  background  type  issues. 
Other  arguments  against  PAM  have  included: 

F.  PAM  Is  a  Gambling  Parlor 

Some  people  consider  gambling  immoral.  For  one  thing,  the  PAM  would 
have  had  a  special  legal  status,  through  negotiations  with  the  Securities 
and  Exchange  Commission  (SEC)  and  the  Internal  Revenue  Service  (IRS), 
resulting  in  limitations  like  the  $100  investment  ceiling  that  would  put  it 
above  the  usual  gambling  laws.  Of  course,  the  question  can  also  be  asked 
“what  is  gambling?”  There  are  speculators  in  all  markets— individuals  who 
believe  they  know  more  than  other  participants  in  the  markets  do. 
Generally,  speculation  is  thought  of  as  gambling.  Sometimes  the  level  of 
speculation  is  much  greater  than  the  hedging  transactions  (purchasing  the 
security  to  hedge  a  risk),  yet  this  activity  is  not  regulated  under  the 
gambling  laws.26 

G.  PAM  Would  Be  Inequitable 

Professor  Joseph  Stiglitz  has  noted  that  terrorism  futures  allow  only  a 
sophisticated  and  wealthy  elite  to  hedge  against  terrorist  attacks,  thereby 
“leaving  the  rest  of  America  fully  exposed.”27  Given  the  limits  on  betting 
size,  this  eventuality  would  be  highly  unlikely.  In  any  case,  the  rich  use 
insurance  to  protect  themselves  against  losses  of  this  sort. 

ASSESSMENT 

By  focusing  on  “terrorist  attacks”  as  the  main  events  traded  on  the  PAM, 
critics  made  it  appear  preposterous  that  any  good  information  could  be 
discovered  that  the  Federal  Bureau  of  Investigation  (FBI)  and  CIA  didn’t 
already  have.  As  noted,  most  of  PAM’s  contracts  would  have  had  nothing 
to  do  with  terrorist  attacks.  Instead,  markets  were  to  be  created  in  more 
mundane  events  like  “How  fast  will  Saudi  Arabia’s  non-oil  gross  domestic 
product  grow  next  year?”  or  “What  chance  does  Prince  so  and  so  have  by 
the  end  of  the  year  in  ascending  to  the  throne  in  Country  X?”  Without 
doubt,  for  these  areas,  considerable  information  exists  that  the  United 
States  does  not  have.  This  information  could  be  converted  at  relatively  low 
cost  into  accurate  intelligence  through  something  like  the  Policy  Analysis 
Market. 
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On  the  other  hand,  DARPA  clearly  oversold  the  plan  by  assuming  its 
markets  would  function  as  predicted  by  the  efficient  market  theory.  If  the 
PAM  were  to  focus  more  on  speculative  events  (like  terrorist  acts),  the 
critics  of  its  main  assumptions  are  on  firmer,  but  certainly  not  completely 
solid  ground.  For  many  of  these  issues,  the  debate  between  the  efficient 
market  versus  the  behavioral  finance  schools  of  thought  would  be  more  in 
favor  of  the  behavioralists.  Robert  Schiller’s  studies  show  that  when 
participants  see  a  trend  in  markets  devoid  of  much  hard  information,  they 
tend  to  extrapolate.28  These  speculative  event  markets,  in  something  like 
the  PAM,  would  no  doubt  tend  to  be  driven  much  more  by  emotional  and 
psychological  factors  than  would  the  more  rational  economic/political 
markets.  Again,  however,  direct  markets  in  terrorist  acts  were  not  foreseen 
as  part  of  the  PAM’s  focus. 

Clearly,  the  PAM’s  dilemma  is  that  it  would  work  best  in  areas  of  general 
interest,  but  would  be  of  much  less  use  in  areas  of  direct  and  immediate 
concern  to  national  security.  Even  if  information  on  general  environmental 
factors  such  as  economic  political  and  social  conditions  were  available,  it  is 
not  at  all  clear  that  markets  would  have  the  expertise  to  convert  the  data 
into  more  accurate  assessments  of  future  terrorist  acts. 

Assuming  that  the  DARPA’s  ultimate  aim  is  to  derive  better  forecasts  of 
political  instability,  terrorist  attacks,  and  the  like,  one  approach  might 
entail  gathering  (in  addition  to  normal  sources  of  intelligence)  relevant 
information  available  on  sites  like  Tradesports.com.  Then,  to  bridge  the 
gap  between  background  intelligence  and  the  prediction  of  terrorist  acts, 
an  internal,  interagency  version  of  PAM,  traded  on  exclusively  by 
governmental  analysts  (and  perhaps  a  select  outside  group  of  academics, 
businessmen,  and  contractors),  could  be  developed. 

APPLICATION  OF  PRINCIPLES 

As  a  case  study  example,  the  market  could  focus  on  the  projected 
effectiveness  of  U.S.  assistance  to  Pakistan  in  combating  terrorism29 
(Figure  3).  Here,  the  information  flow  and  policy  response/impact  might 
be  broken  down  into  four  main  blocks.  The  first  block — -diversionary 
society- — is  the  basic  starting  institutional  setting  in  Pakistan.  The  main 
components,  corruption  and  the  like,  can  be  quantified  sufficiently  to 
assign  rough  magnitudes  of  change  over  time.  Betting  on  changes  in  these 
factors  would  produce  conditional  input  into  the  second,  environmental 
block — concerning  low  economic  freedom  (an  index  for  which  exists  in  the 
literature),  productivity,  and  religious  school  expansion. 

At  this  point,  the  exercise' would  shift  from  public  on-line  sites  to  secure 
internal  sites  with  only  “experts”  participating.  Tfieir  assessment  .and  votes 
on  the  effectiveness  of  proposed  and  discussed  U.S.  aid/assistance 
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Figure  3.  Effectiveness  of  U.S.  Assistance  Programs  in  Combating  Terrorism  in  Pakistan 


responses  would  produce  a  final  set  of  conditional  probabilities  that  would 
in  turn,  drive,  through  bets,  an  overall  terrorism  activity  index  that  could 
be  monitored  and  revised  on  a  daily  basis. 

Which  agencies  appear  to  have  the  best  information?  The  best  analysts?  At 
a  minimum,  the  system  would  assist  in  cutting  through  bureaucratic  and 
institutional  barriers  to  allow  a  better  flow  of  information  between 
agencies  and  even  within  agencies. 


BREAKING  NEW  GROUND 

Although  the  Policy  Analysis  Market  appears  to  be  a  dead  issue,  it  did  break 
new  ground  in  Washington’s  search  for  better  intelligence.30  The  PAM  idea 
embodied  a  solid  body  of  theory  and  proven  empirical  capability.  While 
quibbling  is  possible  about  how  closely  PAM  markets  would  approximate 
the  efficient  market  hypothesis,  trading  on  many  future  events  would 
doubtlessly  come  close  enough  to  provide  valuable  intelligence.  Thus,  while 
the  PAM  concept  was  a  public  relations  disaster,  some  version  of  the 
program  will  likely  be  introduced  on  a  restricted  basis,  perhaps  along  the 
lines  suggested  here,  in  an  attempt  to  better  tap  the  country’s  dispersed 
knowledge  base,  human  insight,  and  analytical  expertise.  This  solution  is 
far  from  perfect,  since  it  would  not  allow  realization  of  the  program’s  full 
potential.  Lou  Dobbs  has  perhaps  best  summed  up  this  unfortunate  episode: 

We  will  never  know  if  the  Policy  Analysis  Market  would  have  been 
successful.  But  if  there  were  even  a  small  chance  that  it  could  have 
been  a  useful  tool,  there  should  be,  at  a  minimum,  further  discussion 
of  the  idea.  This  is,  after  all,  not  a  matter  of  just  partisan  politics  but. 
one  of  national  security.  And  forcing  the  resignations  of  those  involved 
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with  the  planning  is  a  strong  deterrent  to  progressive  thinking,  of  which 
we  have  no  surplus.31 
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